Skip to content

feat(vllm-omni): add MiniMax-H3 request adapter - #13708

Draft
furionw wants to merge 1 commit into
qiwa/omni-video-audio-outputfrom
qiwa/omni-minimax-h3-adapter
Draft

feat(vllm-omni): add MiniMax-H3 request adapter#13708
furionw wants to merge 1 commit into
qiwa/omni-video-audio-outputfrom
qiwa/omni-minimax-h3-adapter

Conversation

@furionw

@furionw furionw commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

Based on #13707.

Why

MiniMax-H3 is available in Dynamo's pinned vLLM-Omni dependency, but Dynamo does not express its startup or request contract. H3 requires model-aware 24-FPS and shape defaults, task inference across two checkpoint partitions, H3-specific sampling controls, and strict reference validation. These behaviors belong in a model adapter so generic video generation remains unchanged.

What Change

  • Forward H3 startup topology, attention, text-encoder, and offload controls.
  • Map task-aware sampling defaults while preserving upstream task inference.
  • Enforce matching H3 request validation in Rust and Python.
classDiagram
    OmniConfig --> BaseOmniHandler : supplies H3 startup controls
    BaseOmniHandler --> AsyncOmni : constructs combined H3 pipeline
    OmniHandler --> OmniDiffusionSamplingParams : maps request controls
    OmniHandler --> OmniTextPrompt : attaches H3 reference lists

    note for OmniHandler "Applies model-aware H3 defaults and task contract"
Loading

Test Plan

  • Run H3 protocol, argument, handler, and reference-contract tests.
  • Exercise task-less T2VA, FL2VA, and Ref2VA input shapes.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` multimodal labels Aug 24, 2026
@furionw
furionw force-pushed the qiwa/omni-minimax-h3-adapter branch from 03e7c26 to e7c2df4 Compare August 24, 2026 03:15
@furionw
furionw force-pushed the qiwa/omni-minimax-h3-adapter branch from e7c2df4 to f7d71e0 Compare August 24, 2026 03:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` multimodal size/XXL

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant